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pFSraiPTION 

T W h n ic-al Field 

5 The present invention relates to human/computer interface input devices, and. more 

particularly, to computer input devices for simulating medical procedures. 

flfrtgrnund Alt 

Virtual reality computer systems provide users with the illusion that they are part of a 
"virtual" environment. A virtual reality system will typically include a computer processor such 
10 as a personal computer or workstation, specialized virtual reality software, and virtual reahty I/O 
Licts such as head mounted display, pointer gloves, three-dimensional ("3D") pointers and 
the like. Virtual reality computer systems have been used successfully for trammg in many 
fields such as aviation and vehicle and systems operation. The appeal of using virtual reality 
computer systems for training relates in part to the ability of such systems to aUow neophy* 
13 practitioners the luxury of operating in a highly reahstic environment and malung d« 
mistakes without consequence to the trainee, others or property. Thus, for example, a trainee 
pilot or automobile driver can learn to fly (or drive) using a virtual reality simulator without 
concern for accidents that would cause death and/or property damage in the real world. 
Similarly, operators of complex systems, e.g., nuclear power plants and weapons systems, can 
safely practice a wide variety of training scenanos that would risk life or property ,f performed 
in reality. 

The advantages of simulation have not gone unnoticed in the medical field, which has 
become increasingly concerned with the costs of malpractice and inefficient care management. 
For example, a virtual reality computer system can allow a doctor-trainee or other human 
operator or user to "manipulate" a scalpel or probe within a computer-simulated body . and 
thereby perform medical procedures on a virtual patient. In this instance, an I/O dev.ee which 
typically is a 3D pointer, stylus, or the like in used to represent a surgical instrument such as a 

scalpel orprobe. A ,t K '^a^f K ^^^^^ m ^^^^ n . 
the screen of the computer system, and the results of the pointer's movements are updated and 
displayed so that the operator can gain the experience of performing such a procedure without 
practicing on an actual human being or a cadaver. 

For virtual reality systems to provide a realistic (and therefore effective) experience for 
the user, sensory feedback and manual interacts should be as natural as possible. As virtual 
reality systems become more powerful and as the number of potential applications increases. 
35 there is a growing need for specific human/computer interface dev.ces which allow users to 
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interface with computer simulations with tools that realistically emulate the activities bein; 
represented within the virtual simulation. Such procedures as laparoscopic surgery, cathete 
insertion, and epidural analgesia should be realistically simulated with suitable human/compute: 
interface devices if the doctor is to be properly trained. 

While the state of the art in virtual simulation and medical imaging provides a rich am 
realistic visual feedback, there is a great need for new human/computer interface tools whicl 
allow users to perform natural manual interactions with the computer simulation. For mediai 
simulation, there is a strong need to provide doctors with a realistic mechanism for performim 
the manual activities associated with medical procedures while allowing a computer to accuratel; 
keep track of their actions. In addition to tracking a user's manual acivity and feeding sue! 
information to the controlling computer to provide a 3D visual represtation to the user, a huma: 
interface mechanism should also provide force feedback to the user, so the user can obtai: 
realistic tactile information as well. Thus an effective human interface not only acts as an inpu 
device for tracking motion, but also as an output device for producing realistic tactile (haptic 
15 sensations. 

There are number of devices that are commercially available for interfacing a human with 
a computer for virtual reality simulations. There are, for example, such 2-dimensional inpu 
devices such as mice, trackballs, and digitizing tablets. However, 2-dimensional input device! 
tend to be awkward and inadequate to the task of interfacing with 3-dimensional virtual realitv 

20 simulations. In contrast, a 3-dimensional human/computer interface tool, sold under the 
trademark Immersion PROBE™ is marketed by Immersion Human Interface Corporation oi 
Palo Alto, California, allows manual control in 3-dimcnsional virtual reality compute* 
environments. A pen-like stylus allows for dexterous 3-dimensional manipulation, and the 
position and orientation of the stylus is communicated to a host computer. The Immersion 

25 PROBE has six degrees of freedom which convey spatial coordinates (x, y, z) and orientation 
(role, pitch, yaw) of the stylus to the host computer. 

While the Immersion PROBE is an excellent 3-dimensional interface tool, it may be 
impropriate for certain virtual reality simulation applications. For example, in some of the 
aforementioned medical simulations three or four degrees of freedom for a 3-dimensional 
30 human/computer interface tool is sufficient and, often, more desirable than five or six degrees oi 
freedom because it more accurately mimics the real-life constraints of the actual medical 
procedure. 

The application of virtual reality simulation to the operation of catheters, and othei 
elongated flexible objects, often require only two, three or four degrees of freedom. In 
35 particular, catheters work in a largely two dimensional environment created by the channel into 
which the catheter is inserted, e.g. 9 a vein or artery. The forces to which a catheter is subjected 

- 2 - 
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often « simplified Compaq ,o othe, medical implements, consist mainly of drag feces. 
Therafora. a .ess complex vinual raahty device is desirable for cenau, apphcauons. 

DiSClaSMg Of invention 

The present iovenUon provides a human/compute, interface rooi which is panrcuiarly 

two degraes of freedom, such as for simulations of esthete, procedures. Thus IT wfil he 
ZZZ ** the prasen, — provides a less complex, mo. compact. 
ST. nenia and .es expensive alternative ,0 a six degree of freedom human/compmer uuerf* 
I ! heramfora avai.ah.e. In panicula,. the preacn, invention include, . means fo 
,0 pmviX ro a user a highiy mafisdc fome feedback ,0 produce the sons of tacuie sensauons 
assoicated with catheter procedures. 

,„ one embodimenr. the present invention includes an apparatus fo, interfacing the 
motion of an elongated fiexthle object capable of transladon and rouuon with an elecmcal 
lem which apparatus includes (a) an object receiving potion and (h) a rorauon transduce, 
15 to the object raceiving porfio, which mtation transduce, is adapted to detent 

JLl motion of the elo„ga*d flexible object; theraby providing an <><— ^ 
interface between the elongated flexible object and the electric*! system. An espeo,al,y preferred 
embodiment is one wherein the electrical system is a digital electrical system. 

In a profaned embodiment, the rotadon transduce, comprises a disk including an 

L m is dimensioned to engaged* mceive the object. The hollow shaft ..eludes at M 
hand The shaft may funhe, include at leas, two substantially pantM secons. In on 
espeeiauy pmfened embodiment, the hollow shaft includes two bends in subsunuafly opposmg 
JL» and *rae substandajly pamliel sections, ta stffl anothe, prafened 
25 apparatus of ft. invemion indudes « acmato, to engage the elongaed flex* bj«t jnd 
•Lauon transduce, coupled to objee, mceiving ponion which ,s adapted to detenmne 
uanslauonal motion of the elongated flexible object. 

In a prafened aftemauve embodiment, a second acruato, and a second transduce, am 
coupled to the object mceiving ponion and am disposed be,ween the actuate, and the tnmslauon 
30 Jduce, and the ,otado„ transduce,. U, son anothe, aheanadve embod men,. 

ft. invention is mounted on a gimba, apparatus including a suppon ». a gmtbal mec^tsm 
having a base, a fust ponion of which base is totatably mounted to the suppon and a second 
ponion of which base is rotatably mounted to the object mceiving ponion. An actuate, and 
uLlation and mtauon nansduccs am funhe, coupled with the object mceivmg ponton. The 
35 mtauon transduce, includes a disk including an apenura dunensioned ,0 mce,ve the elongated 
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flexible object. The disk is coupled with a hollow shaft that is dimensioned to engagedly rece,v< 
the obiect. The hollow shaft includes at least one bend. 

In yet another aspect, the present invention includes a human/computer interface 
including a shaft receiving portion; an elongated flexible shaft engaged with the shaft receiving 
5 portion having a grip area to be grasped by the operator, a first sensor to detect translation* 
motion of the shaft; and a second sensor to detect rotational motion of the shaft, wherein the 
second sensor includes a disk including an aperture dimensioned to receive the elongate, 
flexible object. The disk is coupled with a hollow shaft that is dimensioned to engagedly recem 
the object. The hollow shaft includes at least one bend. 

10 These and other advantages of the present invention will become apparent to those 

skilled in the art upon a reading of the following descriptions of the invention and a study of the 
several figures of the drawings. 

Brief DsssDBlian nf 33k drawings 

Figure 1 is an illustration of a computer/human interface system in accordance with the 
15 present invention. 

Figures 2. 2A and 2B are illustrations of an apparatus for interfacing the motion of an 
elongated flexible object capable of translation and rotation with a computer system. Figure 2 
illustrates an apparatus for interfacing the motion of an elongated flexible object, including 
rotation and translation transducers. Figure 2A is an illustration of an actuator for engaging an 
20 elongated flexible object. Figure 2B is an illustration of a device for determining the translauor, 
of an elongated flexible object. 

Figures 3A and 3B illustrate a hollow shaft used for determining the rotation of an 
elongated flexible object. Figure 3A illustrates a side view of the shaft, including a depression 
of depth "D". Figure 3B is a cross section of Figure 3 A. taken along the line 3B-3B. 

25 Figures 4A and 4B illustrate a second configuratk., of a shaft used to determine the 

rotation of an elongated flexible object. Figure 4A illustrates a side view of the shaft, having a 
bend of depth "D". Figure 4B is an illustration of a cross section taken along line 4B-4B as the 
shaft is rotated through 360°. 

Figures 5A, 5B. 5C. 5D. 5E. 5F and 5G illustrate rotation sensors in accordance with 
30 the present invention. Figure 5A illustrates one embodiment of a rotational sensor of the 
invention including a shaft coupled to a disk. Figure 5B illustrates a second rotational sensor 
including a disk having an aperture dimensioned to engagedly receive a shaft. Figure 5C 
illustrates another rotational sensor embodiment wherein a disk includes a key dimensioned to 
receive a shaft having a flat. Figure 5D illustrates a rotational sensor fixedly coupled to a shaft. 

- A - 
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Figures 5E. 5F and 50 e*h Ulusu,* - — ° f * — ^ *° 
rotation of a shaft is determined using an optical encoder. 

Figure 6 is an illusion of two appamruses of the invention arranged in a undent 
configuration. 

5 Figure 7 is an Ulusuation of an appararus of ft. invention mourned on a gimba, 

mechanism. 

a Hi T"i fiirrfinr"ft Th ''" vm ' i °" 

,„ Figure 1. a virtual reality sysrenr 100 used to simuhtte a meuical procedure including a 

hu JuIpLr tnterface appals ,0, a ^^.^"2^ -. 
10 show „. The illumed vimaal reahty system 100 ts to*** \» v«u J 

1" Sacc -h sLution software with computer inputiourpu, ,*0, 
avlle commercial,,, e.g.. from ta.ne.ion Hutnan Interface Conation of 
15 Palo Alto, California, USA. 

A ctuheter 108 used in conjunction with *e pmseti. invention is manipulated by - 

Tlonse to such manipulations. Preferahly. d. digital processing system ts a phonal 
2 —on, such as an BM-PC AT or Macintosh personal computer. - M« 
20 S In Graphics workstation Most commonly, tire digital processtng system s a pmri 
Ln^uter wL operates under the MS-DOS operating system in confotmance w„h an BM PC 
AT standard. 

,„ addition to a standard cauaeter ,08. the human/inrerface apparatus >»™- 

allow me m p line 1 14 am commercially available 

30 while minimmngussue damage. Catheter lus ana 

from sources such as Targe, Therapeutics of Fremont. California, USA -W! 
Connecticu, USA. Preferably, the carhete, 108 is modified such th* *e d of*e w. uch 
as any cutting edges) am removed, leaving oniy ft. handle and fte shaft. The end o 
cafteL too. 108 is no. required for the virtual reality simulation, and ,s mmoved to prevent any 
35 potential damage to persons or property. 
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The catheter 108 includes a handle or "grip" portion 1 16 and a shaft portion US. Tne 
g np portion can be any conventional device used to manipulate the catheter or me gnp may 
comprise the shaft portion itself. The shaft poruon is an elongated flexible object and » 
particular, is an elongated cylindrical object. The present invention is concerned w,th tracking 
5 the movement of the shaft portion 1 18 in dimensional space, where the movement has 
been constrained such that the shaft poruon 1 18 has only two. three or four degrees of motion^ 
This is a good simulation of the typical use of a catheter 108 in that once the catheter is inserted 
into a patient, it is limited to about two degrees of freedom. More particularly, the shaft 1 18 >s 
constrained at some point of along its length such that it can move with two degrees of freedom 
10 within the patient's body. 

While the present invention will be discussed with reference to the shaft portion 1 18 of 
catheter tool 108. it will be appreciated that a great number of other types of objects can be used 
with the method and apparatus of the present invention. In fact, the present invention can be 
used with any elongated mechanical object where it is desirable to provide a human/computer 
15 interface with three or four degrees of freedom. Such objects may include catheters, 
hypodermic needles, wires, fiber optic bundles, screw drivers, pool cues, etc. Furthermore, 
although the described preferred embodiment of the present invention contemplates the use of a 
elongated cylindrical mechanical object, other embodiments of the present invention prov.de a 
similar human/computer interface for an elongated mechanical objects which are not cylindrical 
20 in shape. 

The electronic interface 104 is a part of the human/computer interface apparatus 102 and 
couples the apparatus 102 to the computer 106. More particularly, interface 104 is used in 
preferred embodiments to couple the various actuators and sensors contained in apparatus 102 
(which actuators and sensors are described in detail below) to computer 106. An electronic 
25 interface 104 that is particularly well adapted for the present is described in U.S. Patent 
Application Serial No. 08/092.974, filed July 16, 1993 and entided "3-D Mechanical Mouse" 
which application is assigned to the assignee of the present invention and incorporated herein by 
reference in its entirety. The electronic interface described therein was designed for the 
Immersion PROBE™ 3-D mechanical mouse and has six channels corresponding to the six 
30 degrees of freedom of the Immersion PROBE. However, in the context of the present 
invention, the electronic interface 104 requires the use of only two, three or four of the six 
channels, since the present invention is preferably constrained to no more than two. three or 
four degrees of freedom. 

The electronic interface 104 is coupled to a human/computer interface apparatus 120 of 
35 the apparatus 102 by a cable 122 and is coupled to the computer 106 by a cable 124. In some 
embodiments of the present invention, interface 104 serves solely as an input device for the 
computer 106. In other embodiments of the present invention, interface 104 serves solely as an 



PCTAJS9S/15301 

WO 96/16397 

. ,r* in vet other embodiments of the present invention, the 

output device for the computer 106. m yei ° 

./ «..,t nin\ device for the computer loo. 
interface 104 serves as an input/output (UU) oevic v 

Apparatus ^^Z^^^ 

e l0 „ga*d W objecr, s«h as acuraror H* -d» ™*uc ' * • ^ 

rotational transducer is rotatably coupled to the object receiving poruon. 

^™?02isoreferablyfasmonedfromaunit^massof material 
The object receiving poruon 202 is preieraoiy mam f . MK i« it 

, 5 ;lln tmnsducer ana rotauon rraosducer. TV object raving poriron - - * 
housing to which various acutators. transducers and sensors are coupled. 

The terms "associated with", "related to", or the like are mean, to 

r^rrrLr^=::^s r 

transducers can F accordance with their respective degrees 

25 which operate both as sensors and as actuator devrces. 

A varies of transducers, readily available in the commercial market, are suitable tor use 

sensors can tnclude encoded wheel transducers. potenuomeKrs. opocal encoders. . Ourp 

a remanent magnet electric motor/generaror. 

„ sh ou.d be noted ft. fte presen, invenrion can urate both absohK. : and reWve 
sensors An absohrre sensor is on. which rhe angle of the sensor ,s known m absolute terms. 
35 riog potentiometer. Relartve sensors only provide relauve an gl e tnformauom 

Td Is tune somelm of caption step whrch provides a reference posmon for the 
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relative angle information. The sensors described herein are primarily relative sensors. In 
consequence, there is an implied calibration step after system power-up wherem the shaft is 
placed in a known position within the gimbal mechanism and a calibration signal is prov.ded to 
the system to provide the reference position mentioned above. All angles provided by the 
5 sensors are thereafter relative to that reference position. Such calibration methods are well 
known to those skilled in the art and. therefore, will not be discussed in any great detail herein. 

In a preferred embodiment, actuator 206 is a solenoid comprising a base/sensor portion 
212 to which is coupled a lower interface 214 by a shaft 216. The lower interface portion 214 
engages elongated flexible object 204 against upper interface portion 2 1 8 by applying a force in 

10 a direction substantially perpendicular to the direction of translation of the elongated flexible 
object 204. which direction is indicated by the linear bi-directional arrow, to produce thereby a 
frictional force along the direction of translation of the object 204. Such solenoids are available 
commercially from, e.g.. Guardian Electric (Woodstock. IL. USA). It will be appreciated that 
other actuator devices may be employed in the invention, e.g.. magnetic particle brakes, such as 

15 those available commercially from. e.g.. Force Limited (Santa Monica. CA. USA). In addmon 
actuator 206 can also be a pneumatic or hydraulic device which applies a force to elongated 
flexible object 204. It will be appreciated by those of skill in the art that the choice of a 
electromechanical, electromagnetic, pneumatic or hydraulic actuator will depend in part on the 
response time, cost and complexity of the device. Preferably, the actuator has a response time 

20 suitable for realistic simulations (i.e.. a fast response time), a low cost and low complexity. 
Electromechanical/electromagnetic transducers are preferred as they typically have a fast 
response time, low cost are smaller and simpler than hydraulic and pneumatic devices 
performing the same or similar function. 

Figure 2A illustrates a preferred solenoid embodiment at 238. Solenoid 238 includes a 
25 base/sensor portion 240 which is coupled with a lower interface 242 though a reciprocating 
shaft 244. Lower interface 242 comprises a platform 246 which is coupled with shaft 244 and 
upon which platform is coupled an optional resilient pad 246 and a brake pad 250. Resilient pad 
246 comprises a substance which effective to act as a shock absorber, such as rubber, and is 
optional. Brake pad 250 comprises a substance which is effective to stop or slow the 
30 translational motion of elongated flexible object 204 when the lower interface 242 engages the 
elongated flexible object 204 against upper interface 252. The materials appropriate for the 
optional shock absorber and brake pad will be apparent to those of skill in the art. Upper 
interface 252 includes a fixed support 254 which may be coupled to the object receiving portion 
or to the base/sensor 240. To the fixed support 254 is coupled a second resilient pad 256 and a 
35 second brake pad 258. both of which are comprised of the same materials as resilient pad 246 
and brake pad 250. 

- 8 - 
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Referring back to Figure 2. in a preferred embodiment, translation transduce, ^208 
includes a wheel 200 which wheel is mounted on a shaft 222 coupled to a sensor 224 wfcch 
sensoriscou P ledtoob j ectreceivin g poruon202byaba S e 226. Trans^uon transducer 208 
adapted to determine transanal motion of elongated flexible object 204 by sensmg 
5 o^eelongatedfiexibleobjec^ 

elongated flexible object 204 with a normal force (downward arrow) such that translate of 
elongated flexible object 204 (indicated by the bidirectional linear arrow) causes rotation of 
shaft end 246 (indicated by the bidirectional curved arrow) creating an electrical stgnal from 
10 sensor 224 (not shown) which is recorded by interface 104 (also not shown) It will be 
appreciated that translation transducer 208 could also be an output transducer (actuator) and 
£y a fricuonal braking force to elongated object 204 to simulate such effects as drag 
experienced by the catheter as the catheter traverses various vessels in the body^ Such 
transducers are well known in the art and available commercially. One preferred transducer ,s 
15 an optical encoder model SI marketed by U.S. Digital of Vancouver, Washington USA. Tins 
transducer is an encoded wheel type input transducer. A preferred output transducer for use of 
the present invention is a d.c. motor model 2434.970-50 produced by Maxon of Fall R.ver. 
Massachusetts USA. This type of transducer is a servo motor type output transducer. 

Referring back to Figure 2. rotauon transducer 210 is rotatably coupled to object 
20 receiving portion 202 to determine the rotational motion of elongated flexible object 204. 
Rotational transducer 210 includes a disk 228 coupled with a hollow shaft 232. Preferably, the 
disk and hollow shaft are attached, e.g.. by gluing or press fitting, to provide a substanuaUy 
unitary device. The disk 228 includes an aperture (not shown) dimensioned to rece.ve the 
elongated flexible object and the hollow shaft is dimensioned to receivably engage the elongated 
^ flexible object such that disk 228 substanually tracks the rotational motion of the elongated 
flexible object 204; yet provides rninimal translation* friction. As the disk rotates in response to 
the rotauonal motion of the elongated flexible object, the rotation of the disk is detected by 
sensor 230. as will be described in greater detail below. 

Hollow shaft 232 is illustrated in greater detail in Figure 3A which provides a cut-away 
30 viewoftheelongatedobjectandthehollowshaftatSOO. Hollow shaft 302 is preferably made 
from stainless steel. The hollow shaft is dimensioned to engagably receive elongated object 304 
with a gap 306 between hollow shaft 302 and elongated flexible object 304 sufficient to allow 
translation of the elongated flexible object without substantial interference from the interior 
surface of the hollow shaft; yet small enough that the hollow shaft routes substanually 
35 continuously with the elongated flexible object. 

Gap 306 is further illustrated in Figure 3B. a cut-away view taken along the line 3B-3B 
of Figure 3A. where the size of the gap is denoted "d". Generally d is chosen such that the 
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hollow and shaft and the elongated flexible object have alight engaging fit. Preferably the 
diameter of the hollow shaft is between about 120% and about 150% of the diameter of the 
elongated flexible object, i.e., the size of the gap is between about 20% and about 50% of the. 
diameter of the elongated flexible object. For example, where the elongated flexible object has z 
5 diameter of about 0.02 inches, preferred values for d are between about 0.001 inches and about 
0.010 inches and, more preferably, between about 0.003 inches and about 0.006 inches. The 
hollow shaft can further include substances to increase or decrease the friction between the 
interior wall of the hollow shaft and the surface of the elongated flexible object. Such 
substances are known to persons of skill in the an. 

10 Referring back to Figure 3A, hollow shaft 302 further includes at least one bend, such 

as that shown generally at 308. where two bends in substantially opposite directions are 
illustrated. In preferred embodiments one or two bends included in the hollow shaft. 
Preferably the sections of the hollow shaft on each side of the bend(s) are substantially parallel. 
The bend(s) function to allow the hollow shaft and disk 228 to track the rotational motion of the 

15 elongated flexible object while offering little impedance to the translauonal movement of the 
elongated flexible object. 

The depth of the bend is denoted by "D". Generally D is chosen such that the hollow 
shaft and elongated flexible object have the desired rotation tracking and translation 
characteristics. It has been found that preferred values for D depend on several factors, 
20 including the stiffness of the elongated object and the tightness of fit between the hollow shaft 
and the elongated flexible object. Suffer elongated objects typically require a smaller value of D 
to achieve desirable rotation and translation properties for a given gap d than more flexible 
objects having the same value of d. For example, for values of d between about 0.002 and 
0.010 inches. D is preferably between about 0.05 and about 0.20 inches, respectively. 

25 Figure 4A illustrates a second preferred embodiment of the hollow shaft at 400. wherein 

a single bend 402 is placed in hollow shaft 404. which hollow shaft includes elongated flexible 
object 406 and gap 408, to divide the hollow shaft into two substantially parallel sections. 
Figure 4B illustrates a cut-away view taken along line 4B^JB of Figure 4A as the hollow shaft 
and elongated flexible object are rotated through 360°. 

30 Figure 5 A at 500 illustrates a preferred embodiment of rotation transducer 2 10 of Figure 

2. In a preferred embodiment, rotation transducer 500 includes a disk 502 rotatably coupled 
with object receiving portion 504 for rotation by hollow shaft 506 and elongated flexible object 
508. The disk is preferably made from a clear, plastic material and is provided with a number of 
dark radial bands 510 near its circumference, such as by printing or silk screening. A 

35 photodetector pair 512 including a light source 512a and a detector 512b are positioned on 
opposing sides of disk 502 in alignment with the bands 510. As disk 502 rotates around an axis 
A, the bands 510 alternatively allow light emanating from light source 512a to impinge or not 

- 10 - 
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non the detector 512b The electronic interface 104, coupled to the photodetector 512 
elongaed flexible object 508 around KB ..T» P ^ jn 

08/275,120. 

Hgure 5B k. - dn. — en, of the rouuon deduce, ^ HS. 
d,sk 520 nek. the rotation of shaft 522 extending engagably through an aperture 52 . d,s 

formadon of a fdedona. sea, between * disk ap^ - ** . 

derai, in cc-pendurg U.S. ^ * £ £ 534 , ncluding a „at 

second alternate embodiment at 530, wherein disk 532 is engagea 

secona » 536 ^e^oned to receivably engage shaft 334 

535. which shaft extends through a key way App Ucation Serial No. 

, c ^ flat 535 This embodiment is also discussed in U.S. Patent Appuc 

Ts/275 120 Both disks 520 and 532 include dark radial bands near their circumferences to be 
used in conjunction with a photodetector as described above. 

h yet another alternate preferred embodiment, shown in Figure 5D at S* — 

transducer^ 

l.o c u ft <aa The sleeve is rotatably coupled to a beanng 550 wnicn oeanng 
20 an end portion 548 of shaft 546. The sleeve ,s rou y P ^ ^ & 

5™£5£r.KS=s=== 

embodiment does not allow translation of shaft 546 through disk 542. 

30 to interface 104. Rotadona, mouon « ft. end f in shaft 564 («. J 

eite direcdon is Ml as described above. Opdca, encode* and ftetr tnterfacmg 
computer devices are known to those of skill in the an. 
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Figure 5G illustrates an alternate emlodiment at 580 wherein the object receiving portion 
582 which fixedly receives shaft 564 is positioned laterally from optical encoder 586 to th«by 
create a bend in shaft 584 as indicated at 588. Rotational motion at the chstal end of the shaft, 
sensed at the optical encoder while .relational motion is sensed as descnbed above. The 
; translations motion of the shaft in the direction of the optical encoder is accommodated I by the 
extension of the bend of the shaft from the position shown at 588 (solid line) to 590 (dashed 
line). Again, the use of optical encoders is known to those of skill in the art. 

In some applications, it will be preferable to link two apparatuses of the invention in 
tandem. For example, in an "epidural" procedure, the physician or practitioner first inserts a 
large bore needle into the patient through which needle a catheter is inserted. Thus, stmulauon 
of an epidural procedure requires simulating independently the responses associated with the 
insertion of the needle and the responses associated with the insertion of the catheter. 

A preferred tandem configuration for simulating a procedure such as an epidural 
procedure is shown in Figure 6 at 600. First and second object receiving portions 602 and 604 
respectively are placed in an adjoining configuration, indicated by the dashed lines, and are 
substantially identical to object receiving portion 202 described above with respect to Figure 2^ 
Both object receiving portions 602 and 604 are adapted to receive "epidural" device 606. which 
device includes external shaft 608 and elongated flexible object 610 which object can be coupled 
to an external control such as handle 612. Within object receiving portion 602 is preferably 
included actuator 614, which actuator includes a base/sensor 616. a lower interface portion 618 
and a shaft 620. in addition to upper interface portion 622 which is coupled to support 624^ 
Object receiving portion 602 also preferably includes translation transducer 626, which 
transducer includes wheel 628 and sensor 630. Similarly, object receiving portion 604 includes 
preferably actuator 632, which actuator includes a base/sensor 634. a lower .nterface portion 
,5 636 and a shaft 638. in addition to upper interface portion 640 which is coupled to support 642^ 
Object receiving portion 604 also preferably includes translation transducer 644. winch 
transducer includes wheel 646 and sensor 648. The actuators and transducers, and theu 
respective components, are all substantially identical to those described above with respect to 
Figure 2. 

30 Object receiving portion 604 is further rotatably coupled to rotation transducer 650, 

which transducer includes disk 652 and sensor 654. Disk 652 is coupled to hollow shaft 656 
which is dimensioned to engagably receive elongated flexible object 610. Rotation transducer 
650 including disk 652. sensor 654 and hollow shaft 656 are of substantially identical to those 
analogous components discussed above with respect to Figure 5A. It will be appreciated that 

35 the alternative rotation sensor embodiments discussed above with resepct to Figures 5B-5G can 
be used as well. 

- 12 - 
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> b addition ,0 the configuration shown in Figure 6. a second 
portion. 

In 300*.: professed embodiment she object receiving portion is pan of a gimba, 
.. . mi h, Finise 7 In the perspective view of Figure 7. the gimba] 

apparatus 700 of the presenl 7M ^ a suppon 

^ k trroar^«Uegs710aand71()b«x K ndingupw^y^rofromtha,a re capable 

and arc preferably within less than one degree of parallel. Similarly, in 
within less than one degree of perpendicular. 

pivorLy coupled *e«ro such as b, a pair of pivo*. one of which ,s shown as p vo 7 6a . * 
7 oTwhich pivot Ues on axis A, Anoto pivot 7!6b (not shown) ts provtded in eg TM*. 
Z i A, and A, am substantia!,, muruany perpendicufe, and hneraecr a. an ongm F-°"£ 
25 „^poLn7.2. Axis Ao aiso intersex to origin O and is substantia.,, perpendtcular 

to axes Ai and A2. 

The object receiving ponion 702 also includes a aeruaror interface 718 and a tnnslation 
• «JT,rt ale preferred embodiment a second aenraror interface 720 and a second 

30 bearing section 722. an acruaror aection 724. a translation sensor secrron 725. and opuonaUy 
rZd^a,orseetion726a^«ans,ation S ection727. shown. ™ °f ™ ^™ 
seconu .u-iuov h-arinie section 722 includes a mass of material 

also includes rotation sensor section 728. The bearing «^ sensor 
nmvided with a cylindrical bore 730 forming a portion of the aperture 7 14. 
^"nlLapairo^^ 
35 with aeylindrical bo* receptive <o me cyhndrica, objec, and formmg a pan of to £«7M 
whrchex^rhroughrheobjecr^eivingponion. The unnsUtion sensor secrton 725 urclude 
I ^ of opposing wal. surf.es 734a and 734h of a wal. and wmch a* provtded wtth 
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cylindrical bores receptive to the elongated flexible object and therefore also forming a part c 
the aperture 714. Optional second actuator sensor section 726 and translation section 72 
include opposite facing walls 738a and 738b and 740a and 740b, respectively, which walls ar 
analogous to the walls of actuator sensor section 724 and translation sensor section 725 ju< 
5 described. In consequence, when an elongated flexible object is inserted into the object ink 
portion 712 along axis Ao it engages the bore 730 of the bearing section 722, and extend 
through bores provided in the surfaces 732a, 732b, 734a, and 734b (and, optionally, surface 
738a, 738b, 740a and 740b) to extend completely through the object receiving portion 70: 
along the aperture 714. In another embodiment of the present invention, walls 735, 746 an« 
10 742 are (and therefore their associated wall surfaces) are eliminated, either singly or ii 
combination, as being superfluous. 

The object receiving portion 702 is preferably a unitary mass of material made fron 
aluminum or some other lightweight material such as a plastic, preferably cast, molded, and/o 
machined as a monoblock member having the aforementioned bearing section, translation 
15 sensory section, and rotation sensory sections. The materials and construction of U-shape; 
base portion 704 preferably match the materials and construction techniques used for tht 
production of object receiving portion 702. 

The gimbal apparatus 700 illustrated in Figure 7 constrains an object that is engaged witt 
the object receiving portion 702 to four degrees of freedom. This is accomplished by allowing 
20 the U-shaped base portion 704 to rotate around an axis Aj relative to the support 706, b> 
allowing the object receiving portion 702 to rotate around an axis A 2 relative to the U-shapec 
base portion 704, by allowing the object to translate as illustrated by the biKiirectional arrow T 
along axis Aoof aperture 714, and by allowing the object to rotate as indicated by arrow "f 
around the axis Ao of aperture 714. 

25 Depending on whether one or two actuator/translation sensor pairs are used, as few a.i 

four and as many as six electromechanical actuators and transducers are used in association witl: 
these four degrees of freedom. More particularly, a first degree of freedom electromechanical 
transducer 744 is coupled between the U-shaped base portion 708 and the support 706, 
second degree of freedom electromechanical transducer 746 is coupled between leg 710a of U- 

30 shaped base portion 708 and the object inlet portion 712, a third degree of freedom 
electromechanical actuator 748. including lower interface 750 and upper interface 752, is 
coupled between the object receiving portion 702 and an object engaged with the objeel 
receiving portion 702, a third degree of freedom electromechanical transducer wheel 754 and 
sensor 756 is also coupled between the object receiving portion 702 and an object engaged with 

35 the object receiving portion 702. Optionally, a second third degree of freedom actuator 758, 
including upper and lower interfaces 760 and 762 respectively, and a second third degree o:l 
freedom transducer wheel 764 and sensor 766 can be coupled as just described for actuator 748 
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. 7 ,, » frtUrth degree of freedom transducer 768. including disk 770, 
and translate transducer 756. A fourth de ^ is _ aged ^een the object receiving 
hollow shaft~772 and sensor 774 as descnbed above. « engageo 
poruon 702 and an object engaged with the object receiving poruon 702. 

. , wavs of ^hing the actuators and transducers to the various 

"7Ai A housing of transducer 746 is attached to leg 710a ot me u 
of a shaft of transducer 744. A housing oi tran r rotalion of the object 

-*» »— I" 1^11 waU of actuator section 724. and a shaft of the 
746. Actuator sensor 748 is atiacnca iu actuator sensor. 

Upper interface 752 is fitted,, anached to a wall of acmatorseeuon ™ *T rf 776 of 

^; rt n im and extends through a bore (not shown) in a wan 

the translation sensor secuon 725. The shaft of whee, » P 

inttrt a« 7,9 and roraKs with the rotation of the tr»s lauo. ■ ^ • 

^on 726 anti Nation section 727 - ^ ^ ^ 

i-^ t« a wall 778 of rotation sensor section 768 and extends tnrougn 

770 to sense the rotation thereof. 

With reference ro all of the figures, and witit patticular reference to figures 1 land 7 th e 
s haft ■ « a catheter 10g is insened into aperrum 714 along axis Ao. caustngthe shaft U8» 
ftictionall, engage the actuaror ht^ace 7,8 and the Ration 
25 instance, the translationa, interface 7,9 ,s a ffcnon wheel madeourof 

The shaft .18 is also in engagement with the .»» t ^l, cause 
shaft 772. Roution of the shaft 1 ,8 arcund the axts Ao as tlhtstrated by the anow 
Nation of di* 770 which is reared on senior 774. A , - ,8 ,ong 

- Ao . however .,, - * ~ — ^ £ ?Z~- 75, A 
30 cause a rotation of the fncuon wheel 754 wnicn rota 

. g tWm --th-,,., ing will cause a rotauon of tne snaii vp« vul ' 
movement up or down of the catheter 108 wm c ^ ^ 

transducer 746, and a side-to-side pivoung of the catheter 108 will 
Aj which is detected by transducer 744. 

te . embodiment wherein catheter ,08 is an "eptduraT instiumen , * — 
ection727andacrua,orseetion726w„lb.used. llK tians,ationa, m o..ono,me need,e 
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be handled by translation section 725 and actuator 724 as described above for the case wherein a 
catheter, is inserted through aperture 714. 

To this point, the majority of the discussion has been under the assumption that the 
transducers are input transducers, i.e., the human/computer interface device is used an input 

5 device to the computer 106. However, it is also been mentioned that the interface device 102 
can serve as an output device for the computer 106. When used as an output device, output 
transducers ("actuators") are used to respond to electrical signals developed by the computer 106 
to impart a force upon the shaft 118 of catheter 108. This can provide useful movement and 
force (haptic) feedback to the doctor/trainee or other user. For example, if the catheter 

1 0 encounters a heavily occluded vessel in the "virtual" patient, a force can be generated by actuator 
748 making it harder for the doctor/trainee to push the shaft 118 further into the gimbal 
apparatus 700. Likewise, twisting motions can be imparted on the shaft 118 when the shaft 
encounters an obstacle within the virtual patient 

It should be noted that force applied to the shaft may not result in any movement of the 
15 shaft. This is because the shaft may be inhibited from movement by the hand of the operator 
who is grasping a handle or grip portion of the shaft. However, the force applied to the shaft 
may be sensed by the operator as haptic feedback. 

With reference to Figure 7, a method for mechanically interfacing an elongated 
mechanical object with an electrical system in accordance with the present invention includes 
20 first step of defining an origin in 3-dimensional space. This corresponds to the origin O at the 
intersection of axes A, and A 2 . A second step is to physically constrain an elongated object in 
the 3-dimensional space such that a portion of the object always intersects the origin O and such 
that a portion of the object extending from the origin O defines a radius in a spherical coordinate 
system. The elongated object (such as shaft 1 18 of catheter 108) is physically constrained in a 
25 3-dimensional space by the aperture 714 of the object receiving portion 702. The portion of the 
shaft 118 extending from origin O defines the radius. A third step includes transducing a first 
electrical signal related to a first angular coordinate of the radius with a first transducer. This 
corresponds to the operation of tra..jducer 744 which transduces a first electrical signal related 
to a first angular coordinate of the radius. A fourth step is transducing a second electrical signal 
30 related to a second angular coordinate of the radius. This corresponds to the operation of 
transducer 746 which transduces a second electrical signal. A fifth step is to transduce a third 
electrical signal related to the length of the radius, which corresponds to the operation of 
transducers 756 and/or 762. A sixth and final step is to electrically couple the transducers to an 
electrical system which, in this instance, is preferably a computer 106. An additional step 
35 transduces a fourth electrical signal related to a rotation of the object around an object axis which 
intersects the origin O. This step corresponds to the operation of rotation transducer 768. The 
transducers can be input transducers, output transducers, or bi-directional transducers. 

- 16 - 
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•n >v noted that the electrical system most frequently described in the present 
It will be noted that the e ear > ^ ^ systems , analog 

invention is ^digital process^ system or a computer ^ $ 

systems, and simple electric or electromechanical system can also be 
and method of the present invention. 

conspurersyssc, Wl-M^ ^ ^ f „, genips . or even orally in case of 
operator. 

n -wi c,fr< «uch as wires or catheters, do not always 
5 u should also be noied M tab., shaft, such as fo[ , 

due* os fous degrees of fre*ons md . sosauou ■ 

caiheter inscnion vutual reality system » desnxd. only ^ ^ 

,«*» such as illusirared in Figure 2 snay he re,u«d „ , w , SKd 

m0 ved in and ou, of a vu.ua! paben, (as se^ by «*. ^^^.^.a 
2 „ or soused <aa sensed by sc<auon J-*, * « on *e ca,he,s. 

While *. — has been descrthed in ,enns of sevesa! 



invention. 
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An apparatus for interfacing the motion of an elongated flexible object capable of 
translation and rotation with an electrical system, comprising: 

a) an object receiving portion; and 

b) a rotation transducer coupled to said object receiving portion, said rotation 
transducer adapted to determine rotational motion of said elongated flexible 
object; 

whereby said transducer provides an electromechanical interface between said elongated 
flexible object and said electrical system. 

An apparatus as recited in claim 1. wherein said rotation transducer comprises a disk, 
said disk including an aperture dimensioned to receive said elongated flexible object; and 
a hollow shaft coupled with said disk, said hollow shaft being dimensioned to engagedly 
receive said elongated flexible object, and said hollow shaft defining a path including at 
least one bend therein. 

An apparatus as recited in claim 2. wherein said hollow shaft comprises at least two 
substantially parallel sections. 

An apparatus as recited in claim 2. wherein said hollow shaft comprises two bends in 
substantially opposing directions and three substantially parallel sections. 

An apparatus as recited in claim 1 further including an actuator coupled to said object 
receiving portion, said actuator adapted to engage said elongated flexible object. 

An apparatus as recited in claim 5. further including a translation transducer coupled to 
said object receiving portion, said translation transducer adapted to determine 
translations motion of said elongated flexible object. 

An apparatus as recited in claim 6. wherein said electrical system comprises a digital 
processing system. 

8 . An apparatus as recited in claim 7. wherein: 

a) said actuator provides a force to said elongated flexible object in response to 
electrical signals from said digital processing system, said force being applied in 
a direction substantially perpendicular to the direction of translation of said 
elongated flexible object; 
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said Kunslation .ransducer — *— ° f - 

to duection of uanslaron of said elongaKd fle*rble ob£ jd 
eJtosl signajs corresponding » said positions for sasd dsgsul proc £ ss,ng 
system; and 

said rotation transducer senses positions of said elongated flexible object along 
HTuon of rotauon of said elongated flexible object and produces electneal 
signals corresponding to said positions for said digital processing system. 

An apparatus as recited in claim 6. further including: 

a) a second actuator coupled to said object receiving portion, said actuator adapted 
engage said elongated flexible object; and 

a second translation transducer coupled to said object receiving portion, said 
JZL transducer adapted to determine mouon of said elongated flexile 
object along the direction of translation of said elongated flexible object; 
wherein said second actuator and said second translation transducer are disposed 
between said actuator and said translauon uansducer and said rotauon transducer. . 

10. An apparatus as recited in claim 6. further comprising: 

a) a support; and 

b) a gimbal mecharusm having a has. wherein a firs, portion of said toe is 
roLbiy coupied .o said suppon. and a second ponion of sa,d base ,s ror*ab,y 
coupied >o said objec, receiving ponion such Una, rhe directions of rouuon of sa,d 
base and said objec, receiving ponion a* subsuntially onhogonal. 

An apparams for imerfacing dre motion of a human nranipuia^ e,onga,ed MU. 
having a, leas, firs, and second degrees of freedom w,h an elecuscal sysrem. 
comprising: 
a) a support; 

a pmbal mechanism having a base wherein a firs, portion of said base is 
JLably coupled ,o said suppon and a second ponion of said base ,s rouuably 
coupied ,o an objec, receiving ponion such ma, said base can be «d ,m a 
direction relative «, said suppon and said objec, giving pomon can be ro,a«d 
in a second direction relative to said base; 

an actuator coupled to said object receiving portion, said actuator adapted to 
engage said elongated flexible object; 



11. 



b) 



WO 96/16397 

d) 



e) 



PCTA3S95/15301 

a translation transducer coupled to said object receiving portion, said translator 
transducer adapted to determine translation^ motion of said elongated flexible 
object; 

a rotation transducer coupled to said object receiving portion to determine 
rotational motion of said elongated flexible object, said rotation transduce, 
including: 

i) a disk, said disk including an aperture adapted to receive said elongated 
flexible object, and 

ii) a hollow shaft coupled with said disk, said hollow shaft being 
dimensioned to engagedly receive said elongated flexible object, and said 
hollow shaft defining a path including at least one bend therein; 

whereby said actuator and said translation and rotation transducers provide an 
electromechanical interface between said human manipulated elongated wire-like objec? 
and said electrical system. 

12. An apparatus as recited in claim 1 1, wherein said hollow shaft comprises at least -two 
substantially parallel sections. 

13. An apparatus as recited in claim 1 1 . wherein said hollow shaft comprises two bends in 
substantially opposing directions and three substantially parallel sections. 

14. An apparatus as recited in claim 1 1. wherein said electrical system comprises a digital 
processing system. 

15. An apparatus as recited in claim 14, wherein: 

a) said actuator provides a force perpendicular to the direction of translation of said 
elongated flexible object in response to electrical signals from said digital 
processing system; 

b) said translation transducer senses positions of said elongated flexible object 
along the direction of translation and produces electrical signals corresponding to 
said positions for said digital processing system; and 

c) said rotation transducer senses positions of said elongated flexible object along 
the direction of rotation of said elongated flexible object and produces electrical 
signals corresponding to said positions for said digital processing system. 

16. An apparatus as recited in claim 15, wherein said actuator is a solenoid and said 
translation transducer includes a translation wheel having a translation wheel axis that is 

- 20 - 



PCT/US95/15301 

WO 96/16397 

that translation of said object causes rotation of said wheel. 

, , . , therein said translation wheel is coupled to a 

17 r ir: - > - — *- - - 

digital processing system. 

18 An nnparams as recired in claim 15. wherein said roraion transducer has an axis of 
reZ which is suhstantially paraUe. ,0 said direcrion of rranslarion. and sa, reason 

is coupled to a rorauonal position sensor wcach provides, a, leas, rn pan. 
electrical signals for said digital processing system. 
19. An apparatus as recited in claim 15. further including: 

„ a second actuator coupled to raid support, said acruator adapred to engage said 

elongated flexible object; and 
b, a second translation transducer coupled to said support, said second translation 

direction of translation of said elongated flexible object; 
wherein said second actuator and said second translation transducer a* disposed 
Ltween sa,d actuator and said translation transducer and said rotauon transducer. 

20. A human/computer interface apparatus, comprising: 

a) a shaft receiving portion; 

an elongated, flexible shaft engaged with said shaft receiving portion, said 
flexible shaft having a grip area to be grasped by the hand of an operator; 

a first sensor coupled to said shaft receiving portion at a first intermediate p«*» 
of said shaft to detect translation* movement of said shaft relauve to sa,d shaft 
receiving portion, said first sensor having a first output; and 
a second sensor coupled to said shaft receivmg portion at a second intermediate 
portion of said shaft to detect rotational movement of said shaft relauve to sa.d 
shaft receiving portion, said second sensor including: 

i) a disk, said disk including an aperture dimensioned to receive said 
elongated flexible shaft, and 

- 21 - 



b) 
c) 

d) 



WO 96/16397 PCT/US95/15301 

ii) a hollow shaft coupled with said disk, said hollow shaft being 
dimensioned to engagedly receive said elongated flexible shaft, said 
hollow shaft defining a path including at least one bend therein. 

21. An apparatus as recited in claim 20. further comprising a first actuator coupled to said 
shaft receiving portion to impart a translational force on said shaft. 

22. An apparatus as recited in claim 20 wherein said flexible shaft is selected from the group 
consisting of wires and catheters. 

23. An apparatus as recited in claim 20. wherein said hollow shaft comprises at least two 
substantially parallel sections. 

24 . An apparatus as recited in claim 20. wherein said hollow shaft comprises two bends in 
substantially opposing directions and three substantially parallel sections. 
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